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In today’s world, Diabetes is one of these diseases and is now a big growing 
health problem. The techniques of data mining have been widely applied to 
extract knowledge from medical databases. In this work, a Medical 
Diagnosis system of Diabetes is proposed for the diagnosis of diabetes in a 
manner that is rapid and cost-effective. three stages are involved in the 
proposed diabetes diagnosis system (DDS) including: dataset constructing, 
preprocessing and classification algorithm using traditional Naive Bayesian 
(TNB) and modified Naive Bayesian (MNB)). MNB Classifier is a modified 
NB that is used to enhance the accuracy of diagnosis, by adding a proposed 
modest model to help separate the overlapping diagnosis classes. The 
outcome showed that the accuracy of MNB classifier is generally higher 
than that of TNB classifier for all sets of features. An accuracy of about 
(63%) was achieved for the TNB model, whereas that of the MNB model is 
(100%). The experimental results showed that the MNB is better than the 


traditional NB in both two cases of constructed medical datasets; the first 
case of filling the missing values by experiences and the second case of 
filling missing values by K-nearest neighbor (KNN) algorithm. 
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1. INTRODUCTION 

Diabetes is an opportune disease which has a large wealth of data available and has huge 
complications. There is a need for a better and more accurate approach to diagnose the patients suffering 
from that disease [1]. Data Mining is one of the most vital and motivating areas of research with the objective 
of finding meaningful information from huge datasets. In the present era, data mining is becoming popular in 
the healthcare field because there is a need for an efficient analytical methodology for detecting unknown and 
valuable information in health data. However, it is still important to have approaches that can facilitate 
accurate diagnosis of the diseases. To this end, data mining is regarded as the most appropriate approach, 
because it is a process through which relevant and concealed information can be extracted from larger 
databases. This process can be executed using a wide range of available data mining techniques such as 
classification, association mining, predictive analysis, and clustering [2]-[5] an intelligent decision support 
system IDSS was designed to help patients and health-care providers [6]. The system was specially tailored 
to provide 24- hour adequate health-care services to diabetes type2 patients remotely, and provide decision 
support service to the health-care providers [7], [8]. The system was designed in a manner that allows the 
periodic updating of patients ’records. [9] addressed the adverse effect of missing value imputation in their 
work, and they also provided a solution for improvement during the evaluation of the performance of K- 
nearest neighbor (KNN) algorithm for the classification of Diabetes data. Their results showed that their 
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novel class-wise K-Nearest Neighbor (CKNN) algorithm significantly improved the accuracy of the CKNN 
method for the classification of diabetes dataset [10]. Their proposed approach is a two-level approach to 
data classification [11]. The initial phase of their method involves the extraction of the best feature set, then a 
new dataset is created as the best training dataset, and subsequently, the optimal feature set undergoes 
classification. Here, a classification mechanism is used for the classification of the testing data features with 
the new dataset; the Bayesian classifier is used for this purpose [12]-[14]. 


2. GENERAL DESCRIPTION OF THE PROPOSAL 

This section provides a general description for proposes model. The model includes constructing the 
dataset, preprocessing, and classification alogorithm used. Figure 1 shows the flowchart of overall diagnosis 
to be carried out using the proposed diabetes mellitus (DM)-diabetes diagnosis system (DDS). Each part of 
the flowchart is explained in the following subsections. 


Construct Diabetes Dataset 
Training (800) 


Training Phase 
Preprocessing Diabetes Dataset 


Traditional Naive 
Bayesian 


Modify Naive 
Bayesian 


Algorithm 


Training 


Algorithm 


Training 


Product Product 
Probability Probability 
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Missing Values 


Divided into 3/4 training & 1/4 
testing 


Test 2 classifier 
algorithms 


Figure 1. Weibull distribution of all filler concentrations 


3. DESIGN AND IMPLEMENT THE PROPOSAL 

In implementing the algorithms of data mining, the KNN, traditional Naive Bayes (TNB) and the 
modify Naive Bayes (MNB) [15]. Dataset divided into training and testing phase; several stages were 
included to obtain the end result of the process of implementation of the algorithms. We used acuuracy ant 
training time for evaluation. 


Diabetes diagnosis system using modified Naive Bayes classifier (Jwan Kanaan Alwan) 


1768 O ISSN: 2502-4752 


3.1. Construct diabetes dataset 

The proposed system was applied on a constructed dataset of 1000 individuals from Baghdad 
society, covering the three classes. The data for this study were collected from the laboratory of Medical City 
Hospital and (the Specializes Center for Endocrinology and Diabetes-Al-Kindi Teaching Hospital) located in 
Iraq the detail information for data explained in Table 1. Before applying mining techniques, there are some 
preprocessing steps that were taken into account so as to prepare the data for training and testing. KNN is the 
critical preprocessing step aimed at filling the missing values, instead of guessing them by experience. Two 
algorithms of data mining were applied in this proposal TNB, and MNB classifier [16], [17]. The main tasks 
performed in the data preprocessing stage include: Removal of Redundancy, Noisy Data. Also, the 
preprocessing stage involved Feature Selection whereby only eight of the attributes collected (Age, Gender, 
HBAIC, TG, Urea, Chol, HDL and BMI) were considered, whereas, the less important features were ignored 
as their information gain is of no significance except for the Blood Sugar Level which was ruled out because 
it is the decisive factor in diabetes diagnosis [18], [19]. The data were applied using two different algorithms, 
and it was found that the level of accuracy was low. To this end, the following section explains how missing 
values were treated using a proposed KNN to increase the accuracy of diagnosis. In the proposed method, 
missing data were estimated and replaced using k-nearest neighbor algorithms. It is important the entire 
dataset be searched when the most similar instances are searched for by the KNN algorithms [20]-[22] based 
on (1). 


h 
E,—E = — (k + k?) (1) 


All symbols that have been used in the equations should be defined in the following text. 


Table 1. Classification Results of TNB and MNB Classifiers (testing of 200 patients) 


Value Classifier___TP__TN__FP__FN Unknown! (Pr-p) _Unknown2 (Pr-n) __ Accuracy 
Without Missing TNB 123 3 25 38 0 11 63% 
MNB 150 39 0 0 11 0 100% 
With Missing TNB 119 3 31 38 2 9 62% 
MNB 120 20 30 19 3 8 71.5% 


3.2. K-nearest neighbor method 

With this simple algorithm, all available cases are stored and new cases are classified based on a 
similarity measure like distance functions [23]. The KNN was used to determine the missing values and to 
avoid the bad impact of the arbitrary speculations of the values. The imputations in the proposal begin with 
the distance similarity measure as in (2). 


D = Y (x1 = y1)? + (2 - y2)? (2) 


3.3. Naive Bayesian classifiers 

In Naive Bayesian (NB) classifier [15] a set of probabilities (a priori, conditional, and posteriori) 
was found instead of constructing a set of classification rules. Assuming the features’ conditional 
independence, as shown in (5) is used to compute the "conditional probabilities" P( [X|C} _i) of the testing 
record at each class. Finally, in (3) is used to compute the "postpriori probability" P(h|X) of the testing record 
at each class, with the class with the maximum posteriori probability h_LMAP being labelled for the testing 
record based on (4). 


_ P(X|h)P(h) 
P(h|X) = Ge (3) 
huap = Arg MAXney = arg max P(X|h)P(h) (4) 


Where, the set of hypotheses is denoted by H This is a statistically optimal classification rule which 
is commonly used to compare the performance of other classification algorithms [24]. Nevertheless, it is 
accompanied by some practical limitations like the need for prior knowledge about many probabilities, and a 
quiet high cost of computation [3]. 


P(C,|X) > P(G |X) 
FOR 1 <J <I ANDJ#1. USING EQ. (3) 
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GETTING 


P(C,|X) = P(X|C:)P(C 


paps PEIC) = M PAIC) 5 


3.3.1. The TNB Algorithm 

In the traditional NB algorithm, each record in the training DDS will be classified through the 
following computations. The conditional probability P (ai Ci) for record's values a_j of its jth feature, that 
exists in the used set of features see Table 2, which has the value aj as the jth feature in class Ci. Assuming 
conditional independence of features, the "conditional probabilities" of the training record at each class are 
computed using (5). To avoid obtaining a zero result with this equation, if the frequency of (aj)as the jth 
feature of the testing record in class Ci equals to zero, then "increase the frequency of (aj) by one", also 
increase the frequency of class Ci in TrainingDDS by "a value that equals a number of available values of 
the jth feature". Finally, the "posteriori probability" of the training record at each class is computed using (2), 
and the class with the maximum posterior probability will be labelled for the training record according to (3). 

Ambica et al. [11] implemented on TrainingDDS with each one of the sets (diabetic, non-diabetic, 
and predicted-diabetic) separately, and the classification of TestinDDS records has been simultaneously done 
with the implementation as shown in Table 3. Bayesian classifier is a simple classifier that requires just a 
one-time scanning of the data, which in turn increases the level of accuracy and speed for large DBs [25]. 


Table 2. The dataset of the DDS 


ID NO Patient GEN AGE Sugar UREA HB CHOL TG HDL BMI CLASS 
1 34325 M 58 6.7 20.8 9.1 6.6 2.9 1.1 33 Y 
2 44835 M 60 10.8 2.1 7.6 3.3 1.7 0.9 36.6 Y 
3 23972 F 56 7 4 9.2 4.1 0.6 1.3 30 Y 
4 34301 F 43 5 2.1 IT 4.7 5:3 0.9 25 P 
5 35150 M 63 9.7 7 7 6 2.2 1.1 28 Y 
6 23973 F 61 T2 5:1 11.5 4.4 2.1 1.1 26 Y 
7 34278 F 46 5.6 3 5.1 5.7 3.8 1.3 24 Y 
8 45703 M 51 12.9 3.9 10.9 3.6 1.1 0.8 29 Y 
9 23974 F 60 6.7 6 10.7 4.4 2.1 1.1 26 Y 
10 34286 F 45 5.7 3.1 4 5.9 1.8 1.6 24 Y 
11 45702 F 54 13 7 7.6 4.9 2.8 0.8 31 Y 
12 23975 M 31 4.3 3 12.3 4.1 2.2 0.7 37.2 Y 
13 34395 F 60 9.3 5.4 6.8 5.1 2.1 1.1 28 Y 
14 43261 F 64 10.2 2 7.9 3:3 3.1 0.9 33 Y 
15 23976 F 61 6.9 4.3 12.1 4.4 2 1 29 Y 
16 20321 M 50 5.3 4.8 5.9 5.3 1.3 1 19 P 


Table 3. The traditional Naive Bayesian (TNB) 


ID NO-Patie GENDE AG Suga Ure HB Co T HD BM Clas Prop c Prop N  Prop_y 
nt R E T a 1 G L I s i 

73 34498 F 54 14.9 2 13. 5 12 1.6 26 Y 0.0072 Y 0 0.00720 
2 8 7 

73 34563 F 57 21.8 43 10. 5.5 1. 1.4 31 Y 0.0378 Y 0 0.0378 
3 2 1 

73 34330 M 60 6.7 35 76 47 1. 0.9 37 Y 0.117 Y 0 0.1171 
4 3 

73 34221 M 26 3.7 45 49 37 L 1.1 23 N 0.0508 N 0.50815 3.8E- 
5 4 005 

73 34473 M 63 13 6.3 12. 5 23 0.8 31 Y 0.1303 Y 0 0.13035 
6 4 5 

73 34409 M 59 10.1 42 89 53 3. 0.7 27 Y 0.1303 Y 0 0.13035 
7 1 5 

73 34370 F 56 8.2 1.9 It 5:5 5s 0.9 33 Y 0.0542 Y 0 0.05422 
8 T 3 

73 34324 F 51 6.6 2.1 59 41 2. 1 36 Y 0.0042 Y 0 0.00420 
9 7 3 

74 34250 M +4 51 3.8 5 3a als 1.1 24 N 0.0608 N 0.06031 3.8E- 
0 5 5 005 

74 34251 F 41 5.1 3.4 4 44 1. 0.8 23 N 0.0211 N 0.02113 1.6E- 
1 6 9 005 

74 34239 F 49 4.9 3.8 4 44 0. 1 23 N 0.0211 N 0.0211 1.6E- 
2 9 005 
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3.2.2. The MNB algorithm 

The use of the traditional naive Bayesian algorithm was employed as a classifier for diabetes disease. 
From examining the results of TNB, (22) status errors were found, such as a diabetic patient (Y) classified as a 
non-diabetic patient (N), shown in Table 4. The overlapping of classifications occurred due to the very nearest 
probability for two classes. This problem was solved by modifying the naive Bayesian classifier, the 
modification was made after the training phase. The modification is summarized in Algorithm 1. Practically, 
Algorithm 1 is implemented on TrainingDDS with each one of the sets (diabetic, non-diabetic, and predicted- 
diabetic) separately, and the classification of TestinDDS records has been simultaneously done with the 
implementation. The Bayes classifier usually works well in MNB, and even when large errors are contained 
in the probability estimates, excellent classification results can be achieved as shown in Table 5. 


Table 4. The TNM module 


ID Sugar HBAIC CLASS _ PROP CLASS-TNB _PROP_N__PROP_Y PROP P SUB THRESHOLD 
7 5.6 Sl Y 0.00029 N 0.00029 1.8e-005 0 0.000272 0.002 
10 5.7 4 Y 0.000812 N 0.000812 2e-006 0 0.00081 
31 6.2 4 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
58 5.7 5 Y 0.00029 N 0.00029 1.8e-005 0 0.000272 
67 6.1 4.9 Y 0.00029 N 0.00029 4.3e-005 0 0.000272 
109 6.1 4.5 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
168 5.9 4 Y 0.00029 N 0.00029 1.8e-005 0 0.000272 
228 5.6 4.1 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
351 6.1 4 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
375 6 4 Y 0.00029 N 0.00029 1.8e-005 0 0.000272 
452 58 4 Y 0.000013 N 0.000013 0.000002 0 0.000011 
552 6.1 5.1 Y 0.000338 N 0.000338 3-e006 0 0.000335 
588 5.7 4 Y 0.000129 N 0.000129 8e-006 0 0.000121 
612 6 5 X 0.00029 N 0.00029 1.8e-005 0 0.000272 
674 5.6 5.2 Y 0.001951 N 0.001951 6e-006 0 0.001945 
694 5.9 4.5 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
714 5.4 5 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 
717 6 4 Y 0.00029 N 0.00029 1.8e-005 0 0.000272 
725 6 53 Y 0.000338 N 0.000338 3e-006 0 0.000335 
750 6.1 4 Y 0.00029 N 0.00029 1.8e-005 0 0.000272 
753 5.7 5.2 Y 0.001951 N 0.001951 6e-006 0 0.001945 
711 _6 4 Y 0.000698 N 0.000698 4.3e-005 0 0.000655 


Table 5. The modified Naïve Bayesian 


I NO_Pati GE AG Sug URE Cr HB CH T HD LD VL B CLA PROP Cc PROP PROP 
D ent N E ar A OL G L L D MI SS I _Y _P 
1 34325 M 58 67 208 80 91 66 2 11l 43 13 33 Y 0.0076 Y 0.007 0 
0 9 21 6 
2 44335 M 60 10. 2.1 56 7.6 33 1. 09 17 08 36. Y 0.0684 Y 0.068 0 
8 7 6 35 4 
3 23972 F 56 7 4 45 92 41 0 13 14 09 30 Y 0.0487 Y 0.048 0 
6 48 7 
4 34301 F 43 5 2.1 55 57 4.7 5 09 17 24 25 P 0.0011 P 0.000 0.001 
3 57 4 1 
5 35150 M 63 97 7 84 7 6 2. Lil 4 1 28 Y 0.1303 Y 0.130 0 
2 5 35 
6 23973 F 6l 7.2 5.1 72 1. 44 2 11 25 09 26 Y 0.0698 Y 0.069 0 
1 61 8 
7 34278 F 46 5.6 3 59: 5.1 5.7 3. 13 2.8 17 24 Y 0.0002 Y  1.8E- 0 
8 9 005 
8 45703 M 51 12. 3.9 53 10. 36 1. 0.8 2.3 1 29 Y 0.1171 Y 0.117 0 
9 9 1 83 1 
9 23974 F 60 67 6 72 #10. 44 2 11 25 09 26 Y 0.0698 Y 0.069 0 
7 1 61 8 
1 43296 F 45 5.7 3.1 54 4 5.9 1. 16 35 08 24 Y 0.0008 Y 2e- 0 
0 8 12 006 
1 45702 F 54 13 7 72 76 49 2 08 3 12 31 Y 0.0698 Y 0.069 0 
1 8 61 8 
1 23975 M 31 43 3 60 13. 41 2. 07 24 15. 37. Y 0.0176 Y 0.017 0 
2 3 2 2 28 6 
1 34395 F 60 93 54 47 68 5.1 2. Ll 3 1 28 Y 0.0542 Y 0.054 0 
3 1 26 2 
1 43261 F 64 10. 2 35 79 53 3. 09 31 14 33 Y 0.0542 Y 0.054 0 
4 2 1 26 2 
1 23975 F 61 69 43 56 12. 44 2 1 25 0.9 29 Y 0.0698 Y 0.069 0 
5 1 61 8 
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Algorithm 1. Customized modify Naive Bayesian 
Input: TrainingDDS training dataset, S set of eight features, see table (2) 
Output: TrainingDDS dataset that has been classified with NB classifier 


4. 


Steps: 
For each class Ci in TrainingDDS, compute it as a probability 


For each record R in TrainingDDS, perform steps 3,4,8 
Initialize MaxValue to a small value 
For each class C; in TrainingDDS, perform steps 5-7 
Compute conditional probability CP of R at Ci, only for 
values of features of R exists in S, using Eq. (5) 
Compute posteriori probability PRŘof R using Eq. (2) 
If PP, greater than MaxValue Then 
MaxValue = PP, and class label = CG 
Assign class_label to the class of R 
Apply the modification process 
Detect status error in training (error classifications) 
Sub with absolute the error class from true class. 
Choose the maximum value of subtraction as threshold. 
In testing, check the subtraction value with the threshold 
If it is larger than the threshold, 
then it means true classification 
Else, consider the sugar test attribute 
as a critical factor for classifications. 
End of step. 


Note: In steps 1 and 4, i equals: 1 to number of classes in TrainingDDS 


IMPLEMENTATION AND EXPERIMENTAL RESULTS 
This section explains the results according to the standards of evaluation of classifications. In each 


of these experiments, two classification models were constructed. Subsequently, the constructed models were 
applied to the same TestingDDS, with the aim of validating the accuracy of the constructed models on the 
same testing dataset. The classification results are either: 


True positive (TP) answers, which means that positive cases as classified correctly (one of DDS). 

True negative (TN), meaning that negative cases (normal) are correctly classified. 

False positive (FP) answers, meaning that negative cases are wrongly classified as positive 
(misclassified records as one of DDS). 

False negative (FN) answers, implying the classification of positive cases as negative cases 
(misclassified records as normal). 

Unknown! (Predicted- Diabetic true positives Pr-p). 

Unknown2 (Predicted- Diabetic true negatives Pr-n). 

The DR is the ratio between the number of correctly classified records as TP and the total number of 
intrusion records presented in TestingDDS dataset. It has been computed using; 


TP 


DR = 
TP+FN+Unknown2 


(6) 


False alarm rate (FAR) is the ratio between numbers of "normal" records classified as an intrusion (FP) 
and the total number of "normal" records presented in TestingDDS dataset. It has been computed using; 


FP 
FAR = ——————_ (7) 
TN+FP+Unknown1 
The classification accuracy measures the proportion of correctly classified cases; 
Tp+TN+TPredict 
Acc = ——* (8) 


~ Tp+Fp+Tn+Fn+unknown 


where, Tpredict is (pr-p) and unknown is (Pr-p+Pr-n) 


It is noteworthy to mention the following, see Figure 2: Without missing. 
TNB classifier achieved the lowest TP, lowest TN, higher FP, higher FN, lowest unknow1, higher 
unknown2?, and lowest accuracy. 
For MNB classifier, both demonstrated higher TP, higher TN, lowest FP, lowest FN, higher unknown1, 
lowest unknown2, and higher accuracy. 
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- The accuracy of the training TNB model has been found to be approximately (63%), while MNB 
achieved an accuracy of (100%) as shown in Figure 2. It can be deduced that the rate of accuracy of the 
system DDS for the model MNB is the best average results. 

With missing: 

- TNB classifier achieved a higher TP, lower TN, higher FP, higher FN, lowest unknowl, higher 
unknown2 lowest accuracy. 

- MNB classifier achieved a higher TP, higher TN, higher FP, higher FN, lowest unknowl, higher 
unknown2, and higher accuracy. 

- The accuracy of the training TNB model has been found to be approximately (62%), while MNB is 
(71.5%). It can be deduced that the rate of accuracy of the system DDS for the model MNB is the best 
average results. 


= Without Missing TNB = Without Missing MNB m With Missing TNB m With Missing MNB 


a 
E] 
E 160 
Q 
& 140 
2 120 = 
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= 100 = 
2 30 -S 
= = 
I 60 =: 
E 0 € == 
» | TEIL 
0 & — E = z =S = = 
TP TN FP FN Unknown]! Unknown2 


(Pr-p) (Pr-n) 
Quality classes 


Figure 2. The training dataset results 


Table 6 presents the results obtained from the test of the two classifiers with and without missing 
values; the results are presented as follows, see Figure 3. 


Table 6. DR and FAR of two algorithms (TNB and MNB) classifiers testing 


Value Feature TNB Classifiers MNB Classifiers 
Selection Measure DR FAR DR FAR 
Without Missing Eight 0.715 0.892 1 0 
With Missing Eight 0.716 0.861 0.816 0.566 
=DR SFAR 
1,2 
Es 

A 1 == 

S =— 
S] 0,8 === = 
E 06 = = = 
5 i = = = 
Š == == == 
È 0,4 = — = 
== = = 
0,2 = =| = 
== == == 
0 = — = 

TNB without missing TNB with missing MNB without MNB with missing 
True classes missing 


Figure 3. Accuracy of System with missing and without missing 
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The performance of the classifiers is estimated statistically using the time taken for training. The 
training time is the time required to build the classifier. The DDS will present TNB as the faster training 
model, MNB is the second best in terms of speed. The time recorded for TNB was (00:37:99) ms, while that 
of MNB was (1:16:60) ms. The measure is (Hours: Minutes: Seconds: Milliseconds). 


5. CONCLUSION 

Diabetes is a good candidate for research since it has a lot of data and a lot of problems. There is a 
need for a better and more precise method of diagnosing people with that illness. The proposal system 
proposes a simple modification on the traditional naive Bayesian algorithm to overcome the overlap that 
happens in it. MNB gives substantial high and optimal accuracy. It can be observed that a comparison has 
been done among the algorithms to determine which has the best performance. Despite the fact that the time 
required by the Tradition Naive Bayes to build the model is less than that required by others, it was observed 
that in terms of other parameters, the performance of Modified Naive Bayes is better. The time needed for 
building (training time) is estimated to 37:99 ms in the case of TNB while 1:16:60 ms for MNB. When has 
tested the system in Al- Kindi Hospital and identified that the percentage of error is (4%), and confirmed that 
the system is working correctly. When taken a large number of patients as input to the system will produce 
excellent results. Reduced cost of patient management: with such systems, there could be a decrease in the 
cost required for patient management by sidelining unnecessary investigations and patients follow up. Our 
future work will be devoted toApplying another classification algorithm, such as support vector machine 
(SVM) to accomplish a comparison study among the classification algorithms extended the algoritm to deal 
with more than one. DDS can be uploaded on a free web page to become an online assist readily available to 
any person who wants to test his/her status. It is a good suggestion to insert automatically the record of the 
patient who is being chosen to diagnose his/her status, and in this case, a large database can be obtained. 
Accordingly, the administer can re-train DDS to increase its accuracy and to avoid the care of overlapping. 
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